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(54) Title: IMPROVEMENTS IN OR RELATING TO WATERMARKS 

(57) Abstract 

The present invention relates to a 
method and apparatus for detecting the 
presence of a watermark in digital data. 
The digital data may represent picture or 
sound information and may be in the form 
of a broadcast television signal or a signal 
that has been recorded on a recording 
medium such as a compact disc. Hie 
watermark includes coefficients which have 
been subject to an inverse local orthogonal 
transform before being embedded in the 
input data. In order to detect me presence of 
the watermark, the input watermarked data 
is first forward transformed and subtracted 
from the watermark coefficients so as 
to derive the data coefficients. The data 
coefficients are squared and formed into 
a local average to obtain a measure of the 
power in the local average. The watermark 
coefficients are divided by the local average 
so as to scale them and the scaled watermark 
coefficients are cross-correlated with the 
input data to detect whether the watermark is 
present The cross-correlation is performed 
by means of a multiplier receiving the input 
data as a first input and the scaled watermark 
coefficients as a second input. The resulting 
output detection signal is subjected to a 
thresholding operation using a. threshold 
set in dependence upon the global average 
power of the input data set 
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IMPROVEMENTS IN OR RELATING TO WATERMARKS 

The present invention relates to a method and apparatus for detecting a 
watermark. The invention has particular application to detecting a watermark 
in a digital picture or sound signal. 

Watermarking is a well known technique which is used to protect against the 
fraudulent copying or counterfeiting of documents or currency. The physical 
medium carrying the document or currency is marked with a distinctive and 
recognisable mark which it is difficult to remove. In more recent times a need 
has arisen to protect digital signals representing picture information or audio 
information by means of a distinctive watermark. A watermark may be used to 
establish the true origin or ownership of the picture or audio information that is 
represented by the signals. It can be of particular benefit in the fields of 
digitally broadcast television signals and digitally recorded picture or sound 
signals. 

The watermarking of documents or currency requires the watermark to be 
readily visible to assure the person examining the document or currency that 
the document or currency is genuine and has not been counterfeited. A 
physical technique of this sort is of course inapplicable to the protection of 
digital signals. Digital signals can be manipulated using digital techniques 
thus removing an existing watermark and possibly introducing a fresh 
watermark. The watermark for protecting a digital signal therefore should be 
obscured from an observer or listener of the information represented by the 
digital signal and should be difficult if not impossible to remove. The 
watermark should still be detectable by the originator of the watermark to 
determine if a signal is genuine. 

In addition it is advantageous that the watermarking for digital signals be 
sufficiently robust so as to be capable of withstanding the compreissibn and 
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decompression common in digital broadcasting techniques while still reliably 
indicating that the signal has been watermarked. 

Existing watermarking schemes use a technique in which a watermark is 
generated from a random number sequence and added to the original picture 
or sound information to form a watermarked signal in which the watermark is 
obscured. When it is desired to detect the presence of the watermark, the 
watermarked signal is correlated with the watermark to generate a correlation 
signal which reveals the watermark. 

A problem with the existing technique is that the watermark which is revealed 
through the correlation may be difficult to perceive. This may be due in part to 
the introduction of noise into the watermarked signal and may also be due to 
the difficulty in distinguishing the watermark from the information represented 
by the signal. 

A need therefore exists to improve the - correlation for detecting the 
watermark. 

According to the present invention there is now provided a method of 
detecting the presence of a watermark in input digital data, the watermark 
including coefficients embedded in the data, the method comprising the steps 
of, transforming the data and applying the transformed data as a first input 
and the watermark coefficients as a second input to a cross correlator so as 
to generate an output detection signal, characterised in that the method 
further includes scaling the cross correlation by a predetermined 
characteristic of the data. 

significantly less noisy than in a conventional detector. 
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Further according to the present invention, there is provided apparatus to 
detect the presence of a watermark in input digital data, the watermark 
including coefficients embedded in the input data, the apparatus comprising 
means to receive and transform the input data, a cross correlator having a 
first input to receive the transformed data and a second input to receive the 
watermark coefficients, the cross correlator being effective to generate an 
output detection signal, characterised in that scaling means are provided to 
scale the cross correlation by a predetermined characteristic of the data. 

The invention will now be described f by way of example, with reference to 
the accompanying drawings in which; 

Figure 1 shows a block diagram of a known apparatus for embedding a 
watermark into a signal to be protected by the watermark, 

Figure 2 shows a block diagram of a known apparatus for detecting the 
presence of a watermark, and 

Figure 3 shows details of apparatus according to the present invention for 
detecting the presence of a watermark in a watermarked signal input to the 
apparatus, 

Figures 4 and 5 show a method of generating watermarked coefficients in a 
video signal which is subject to an inverse DCT transform, 

Figure 6 shows a second apparatus according to the present invention for 
detecting the presence of a watermark in the watermarked coefficients of 
Figures 4 and 5, 

Figure 7 shows the location of watermarked coefficients which have been 
subject to a forward DCT transform, 
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Figures 8 and 9 show two images of which one is original and unwatermarked 
and the other is watermarked, 

Figure 10 is a graphical diagram of the correlation detected by the apparatus 
of Figure 2 including a conventional detector, and 

Figure 11 is a graphical diagram of the correlation detected by the apparatus 
of Figure 6. 

Figure 1 shows a source of unwatermarked data 10 which is intended to be 
combined with a watermark in a combining means 11 to generate 
watermarked data 12. The unwatermarked data 10 consists of a stream of 
digital data for example which represents picture or sound information and 
may constitute a video signal. The video signal may be a television broadcast 
signal or may be a video signal which is to be sent for recording on a 
recording medium such as a compact disc, laser disc, etc. In an alternative 
case, the unwatermarked data may be representative of sound information 
which is to be broadcast or to be recorded on a suitable recording medium 
such as a compact disc. The unwatermarked data is divided into a sequence 
of individual digital data sets or frames before being applied to the combining 
means 1 1 . The watermark is applied to one or more of the digital data sets or 
frames. The watermark may be chosen to apply to a given succession of say 
five data sets or frames or may alternatively be applied to a known selection 
of individual data sets or frames. 

The watermark consists of a series of watermark coefficients which are 
generated by means of a pseudo random number generator 13. The pseudo 

secure random sequence of numbers known only to the owner of the data. 
The pseudo random number generator 13 has an input to receive a 
watermark modulation key 14 which predetermines the initial state of the 
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number generator 13 and therefore the coefficients that are generated by the 
number generator 13. 

The copyright information is embedded 13 by means of the embedding device 
16 into the random number stream from the number generator 13. The 
copyright information may be a text legend or graphical information or other 
distinguishing information supplied from a copyright source 17. The 
embedded watermark coefficients are passed to a modulator 18 to be 
subjected to an inverse local orthogonal transform before being combined 
with the unwatermarked data in the combining means 11. The inverse 
transform may be chosen from a number of known such transforms including 
for example the inverse discrete cosine transform (DCT) which is well known 
in the field of compression of digital television signals. The purpose of the 
inverse transform is to spread the spectrum of the watermark . The result is to 
obscure the watermark when combined with the unwatermarked data. 

The inverse transform applied to the watermark coefficients may be controlled 
by transform and analysis module 19 using the local data properties of the 
unwatermarked data. The data properties of the unwatermarked data are 
derived by a forward transform and analysis in the module 19. 

It will be apparent to those skilled in the art that the source of copyright 
information may be omitted so that the watermark coefficients are applied 
directly from the number generator 13 to the modulator 18. Furthermore, the 
module 19 may be omitted so that the inverse transform applied to the 
watermark coefficients is not modified by the data properties of the 
unwatermarked data. 

The invcrrc trrn:?form employed In fh~ mediator 18 nroaps the random 
numbers appropriately to create the spectrum that is required. Low frequency 
terms are used in the inverse transformation because these withstand 
compression and decompression more robustly than higher frequency terms. 
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Turning now to Figure 2, there is shown a known method of detecting a 
watermark in the data that has been watermarked as described with 
reference to Figure 1. The watermarked data 12 is applied in the known 
detection apparatus as one input to a subtracter 20. The subtracter 20 
receives the original uriwatermarked data 21 as another input and generates 
an output consisting of the inverse transform of the watermark coefficients. A 
forward transform of the result from the subtracter 20 is performed by a 
forward transform generator 21. In the case where the inverse transform is an 
inverse DCT transform, the forward transform is the DCT transform. The 
result of the forward transform is applied as one input to a detector 22. 

The detector 22 has another input from a pseudo random number generator 
23 which is of the same form and construction as the generator 13 of Figure 
1. The generator 23 receives a watermark modulation key 24 to correspond to 
the watermark modulation key 14 delivered to the generator 13. The detector 
22 performs a cross correlation between the forward transform produced by 
the generator 21 with the coefficients generated by the generator 23 to 
produce an output detection signal 26. The output detection signal 26 may be 
taken as indicating the presence or absence of a watermark or may be 
interpreted to extract embedded copyright information. 

Referring now to Figure 3, a method and apparatus embodying the invention 
is shown for detecting the presence of the watermark in the watermarked data 
12. The watermarked data is first transformed by the forward transform 
generator 21 in the manner already described with reference to Figure 2. The 
transformed data 21 is applied as one input to a cross correlator including a 
multiplier 30 and a divider 31. The watermark coefficients are applied to 
a\:A]t::' k>\.-v f Ti? r T ^;-?'c; ?*.y mcrrtc of V'r. p?c:Ho r<:\; J Z::: nuTibe r 
generator 23. The generator 23 receives the watermark modulation key 24. 
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The transformed data coefficients are applied to a squarer 33 to form the 
square of the data coefficients from which the local average is formed in an 
averager 34; The result of the operations in the subtractor 32, the squarer 33 
and the averager 34 is to compute a local average 32 of the power of the data 
coefficients. These operations may be represented by the following equation: 

where F* is the local average power in K samples of the data sequence, K, is 
the set of neighbours used in the computation, N, is the number of members 
in the set, Gj are the set of transformed data coefficients. 
The divider 31, divides the watermark coefficients by a scaling factor. This 
scaling factor is determined by the local average 32 of the power of the data 
coefficients. The divider output is applied to the multiplier 30. The multiplier 
then cross correlates the transformed data 21 with the divided watermark 
coefficients. This produces a detected correlation signal for the set of 
neighbours used in computing the local average power. The detected 
correlation signal is then applied to a global averaging means 35 .to. form a 
global average of the correlation signal for all the samples in the data 
sequence that makes up the set of data 21. The global average is passed to 
a further divider 36. 

The local average computed in the averaging means 34 is applied to an 
inverter 37 to produce a local average inverse signal. This local average 
inverse signal is applied to a global averager 38 to form the global average for 
the set of data 21 of the inverse signals from the inverter 37. 

the global average from the averager 38 is subject to a square root operation 

in the square root means 39 and then appiieci as a second input io ti te divider 
36. The division in the divider 36 forms a result which is a detection signal D 
which can be represented by the following equation 
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1 v G,W, 




(2) 



The detection signal D is finally subject to a thresholding operation in the 
threshold circuit 40 to produce a detector output signal 41 . 

The detection threshold T is set in the threshold circuit 40 such that the 
probability of the detection signal D being greater than T when the watermark 
is not present gives an acceptable maximum false alarm possibility of P 
where P is given by the following equation; 



It will be apparent from the block diagram of Figure 3 that the cross 
correlation occurring in the multiplier 30 is performed using the watermarked 
coefficients which have been scaled by the scaling factor 32. The process of 
dividing the watermark coefficients by the scaling factor 32 reduces 
considerably the level of the noise occluding the estimate of the watermark 
amplitude. 

The scaling factor 32 may be applied to scale the input data instead of the 
watermark coefficients. This can be achieved by interposing the divider 31 
between the transformed data stream 21 and the multiplier 30 instead of 
between the random number generator 23 and the multiplier 30. In yet 
another alternative, the scaling factor 32 can be used to scale the result of the 
cross correlation from the multiplier 30 instead of the watermark coefficients. 
k : , co-~f : \ Y.'!\h!, - Y,;:.;.:?:v~ r. rho^:i rrl-v, r-'ir.V cf the rc-'h- 
factor 32, the result is to effect a scaling of the crass correlation performed by 
the multiplier 30. 




(3) 
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The detection signal D is derived in the divider 36 from the global average 
supplied by the averager 35 and the square root operation performed by the 
square root module 39. The detection signal D has a Gaussian distribution 
when no watermark is present. The Gaussian distribution is such that the 
probability that the signal D would exceed the threshold T can be made 
extremely remote. A high degree of assurance is thereby provided of the 
detection of the watermark when the detection signal D exceeds the threshold 
T. 

The apparatus shown in Figure 3 may be applied to the detection of 
watermarks in video signals as will now be described with reference to 
Figures 4 to 11. The watermark coefficients are generated by first taking 
empty video frames and dividing each such frame into 16x16 small blocks. 
The number of blocks in each frame may be of a value other than 16 x 16 as 
will be apparent to those skilled in the art. Figure 4 shows in diagrammatic 
form an empty video frame 40 and four of the blocks into which it is divided: 
The first three blocks are numbered 1 to 3 and the last block is M. 

Figure 5 shows one of the blocks in the frame 40. The block shown in Figure 
5 is representative of each of the blocks in the frame 40 and as shown is 
itself divided into a number of locations. In the specific example described 
here, there are 4 x 4 locations in each block. Some of the locations in the 
block are populated with watermark coefficients W, to W 5 . The chosen 
locations are distributed in the upper left hand portion of each block. 

The inverse DCT of each block is taken to construct the actual watermark. It 
will be seen from Figure 5 that the population of watermark coefficients W 1 to 
W 5 correspond to the low frequency bases of the DCT transform and that the 

PC t:m l? vxclvtieri'. The process of conPtn'rfhn the inverse transform of the 
watermark coefficients is repeated for all the blocks of a frame so as to 
construct a complete watermark frame. The watermark frame is added to a 
video signal frame to produce a watermarked video frame. The same 
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process is repeated for all the video frames which it is desired to mark in a 
sequence of frames in a video signal. 

The apparatus in Figure 6 is adapted to receive the frames of the video signal 
which have been watermarked as described with reference to Figures 4 and 
5. The received video signal 60 is transformed by the forward transform 
generator 61. The forward transform generator divides each video frame into 
the same pattern of blocks as before (in the specific example 16x16 blocks) 
and takes the forward DCT transformation of each block. The result is to 
reverse the inverse transformation described with reference to Figures 4 and 
5. 

The unmarked video coefficients in each block are discarded resulting in the 
five marked coefficient locations to G 5 in each block as shown in Figure 7. 
The marked coefficients are supplied by the forward transform generator 61 
as one input to the cross correlator comprising a multiplier 60a and a divider 
61a. The 5 marked data coefficients in each block are presented as 5 
neighbouring data samples. 

It will be apparent to those skilled in the art that the number of data samples 
in each block is a matter of design choice and may be equal to a value other 
than 5. In general the number of data samples in each block presented to the 
cross correlator is K samples. The data samples presented by the forward 
transform generator 61 takes the form; 

{{g/g;.^ 

where G/ is the ith sample from the block j. The total number N of the 
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The watermark coefficients are applied to another input to the detector of 
Figure 6 by means of the pseudo random number generator 23a which 
receives the watermark key 24a. 

The watermark coefficients W from the generator 23a are ordered in the 
same manner as the transformed data coefficients and appear in the form; 

{{w 1 1 w;..w K 1 },{w 1 2 w 2 i.w K 2 },....,{w 1 M w 2 M ..w K M }}. 

The marked data coefficients from the generator 61 are fed into the cross 
correlator of Figure 6 in synchronism with the generation of the watermark 
coefficients by the generator 23a. The marked data coefficients are supplied 
to a squarer 63 where they are squared before being supplied to an 
accumulator 64a. The end of each block of marked coefficients is detected 
by a detector 64b which latches the accumulator 64a to cause the 
accumulated value of the marked data coefficients to be passed to a multiplier 
64c. The multiplier 64c multiplies the accumulated value by 1/N thereby to 
derive the local average 62 of the power of the marked data coefficients in 
each block. 

The watermark coefficients from the generator 23a pass through a delay 
device 70 to the divider 61a. The delay device 70 imposes a delay on the 
incoming watermark coefficients to compensate for the delay in processing 
the marked data coefficients through the squarer 63 , the accumulator 64a 
and the multiplier 64c. The divider 61a thus receives the local average from 
the multiplier 64c in synchronism with the watermark coefficients from the 
delay device 70. The divider 61a scales the watermark coefficients of each 
block by the scaling quantity 62 which is the local average power for the 
marked data coefficients in the same block. The scaling quantity is clipped by 
c c! ; ;v c:^.' : -' ClO Ufc-r? r; ?.? Viz c^tf;- <?1r. Tl/ ^.'."y.-.-y: 

coefficients are scaled before application to the multiplier 60a to enhance the 
quality of the watermark amplitude estimate. 
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It will be apparent that the divider may be interposed betwen the data stream 
61 and the multiplier 60a instead of between the delay device 70 arid the 
multiplier 60a. In this case the scaling quantity 62 would be employed to scale 
the data stream 61 instead of the watermark coefficients. In yet another 
alternative, the scaling quantity 62 may be used to scale the output from the 
multiplier 60a. 

The local average for each block generated by the multiplier 64c is applied to 
an inverter 67 to produce a local average inverse signal. The local average 
inverse signal from the inverter 67 is applied to an accumulator 68a which 
accumulates successive inverse local averages. The end of each video 
frame signal is detected by an end of frame detector 68b which supplies an 
end of frame signal to the accumulator 68a. The end of frame signal latches 
the accumulator 68a to pass the accumulated inverse local average values 
therein to a multiplier 68c. The multiplier multiplies the output from the 
accumulator 68a by 1/N thereby to derive a global average over each frame 
of the power of the marked data coefficients. A square root module 69 
generates the square root of the global average from the multiplier 68. 

The cross correlation performed by the multiplier 60a results in a cross 
correlation signal representing the correlation between the watermark 
coefficients and the marked data coefficients for each block in each frame of 
the video signal data. The cross correlation signals are passed to an 
accumulator 65a where the cross correlation signals are accumulated. The 
end of frame signal from the detector 68b latches the accumulator 65a and 
causes the accumulator to pass the accumulated cross correlation signals to 
a multiplier 65b. The multiplier multiplies the accumulated cross correlation 
signals by 1/N to derive a global average for each video frame. 

The global average of the cross correlation signals is divided by the output 
from the square root module 69 to produce an output detection signal D. The 
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output detection signal D is subject to a thresholding operation by a threshold 
circuit 71 to produce a detector output signal 72. 7 

Referring now to Figures 8 and 9 there are shown two samples of a video 
image. Figure 8 shows an original image which includes no watermarked 
coefficients. Figure 9 shows the same image but modified to include 
watermarked coefficients. Whilst the two images resemble one another so 
closely that the watermark is obscured to a viewer, it is necessary that the 
detector of the watermark should be able to discriminate between the two 
images with a high degree of assurance that one contains a known 
watermark whilst the other does not 

Figure 10 shows the response to be expected from a conventional detector. 
The detector output line 81 shows the detected correlation between the 
correct watermark coefficients and a watermarked video image such as that 
of Figure 9. The detector output line 82 shows the detected correlation 
between a set of incorrect watermark coefficients and the watermarked 
image. Two possible threshold levels 83 and 84 are shown in Figure 10 and 
it will be seen that the discrimination between a correct watermark and an 
incorrect watermark is relatively narrow. A threshold set at the level 84 would 
be unsatisfactory because there is the possibility of falsely detecting a 
watermark as shown where the line 82 exceeds the threshold 84, The 
threshold 83 is satisfactory but must be set carefully to avoid the possibility 
that the detector output line 81 does not drop below the threshold. 

A feature of the detector output lines 81 and 82 jn Figure 10 is that both 
deviate substantially from a median line. This is because of the relatively high 
noise levels associated with such a detector. 

Turning now to Figure 11, there is shown the response from the detector of 
Figure 6. The line 91 shows the detected correlation between the correct 
watermark coefficients and the marked data coefficients of a vjdeo image 
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such as shown in Figure 9. The line 92 shows the detected correlation 
between incorrect watermark coefficients and the video image. Two possible 
threshold levels are shown at lines 93 and 94. It will be observed that the 
detector outputs represented by the lines 91 and 92 show a wide 
discrimination between a correct and an incorrect watermark. The output in 
each case is also subject to much less deviation than the corresponding 
output shown in Figure 10. As a consequence the threshold for the detection 
of a correct watermark can be set at a value which substantially removes 
uncertainty in detecting the watermark. 
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CLAIMS 

1. A method of detecting the presence of a watermark in digital data, the 
watermark including coefficients embedded in the data, the method 
comprising the steps of, transforming the data and applying the transformed 
data as a first input and the watermark coefficients as a second input to a 
cross correlator so as to generate an output detection signal, characterised in 
that the method further includes scaling the cross correlation by a 
predetermined characteristic of the data. 

2. A method as claimed in claim 1, wherein the step of scaling the cross 
correlation comprises scaling the watermark coefficients applied as the 
second input to the cross correlator. 

3. A method as claimed in claim 1, wherein the step of scaling the cross 
correiation comprises scaling the transformed data applied as the first input to 
the cross correlator. 

4. A method as claimed in claim 1, wherein the step of scaling the cross 
correlation comprises scaling the result of the cross correlation. 

5. A method as claimed in claim 1, 2, 3 or 4, wherein the transformed data is 
applied to squaring means to form a local average of the power of the data 
within a global average encompassing the data, the local average being 
employed to scale the cross correlation. 

6. A method as claimed in claim in claim 2, wherein the scaling of the cross 
correlation is performed by dividing the watermark coefficients by the local 
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7. A method as claimed in claim 6 wherein the transformed data is multiplied 
by the scaled watermark coefficients to cross correlate the data with the 
watermark coefficients. 

8. A method as claimed in any one of the preceding claims, wherein the 
output detection signal is subjected to a thresholding operation. 

9. A method as claimed in claim 8, wherein the thresholding operation is 
preceded by dividing the detection signal by a signal dependent on the global 
average of the power of the data. 

10. A method as claimed in claim 9, wherein the detection signal is averaged 
before being divided. 

1 1. Apparatus to detect the presence of a watermark in input digital data, the 
watermark including coefficients embedded in the input data, the apparatus 
comprising means to receive and transform the input data, a cross correlator 
having a first input to receive the transformed data and a second input to 
receive the watermark coefficients, the cross correlator being effective to 
generate an output detection signal, characterised in that scaling means are 
provided to scale the cross correlation by a predetermined characteristic of 
the data. 

12. Apparatus as claimed in claim 11, wherein the scaling means is adapted 
to scale the cross correlation by scaling the watermark coefficients applied to 
the second input to the cross correlator. 

13. Apparatus as claimed in daim 11, ^'hpreln the scaling me^n? i? adapter* 
to scale the cross correlation by scaling the input data applied to the first input 
to the cross correlator. 
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14. Apparatus as claimed in claim 11, wherein the scaling means is adapted 
to scale the cross correlation by scaling the result of the cross correlation. 

15. Apparatus as claimed in claim 1 1 further comprising a squarer to receive 
the transformed data and to form a local average of the power of the data 
within a global average encompassing the data, the scaling means being 
effective to employ the local average to scale the cross correlation. 

16. Apparatus as claimed in claim 12, wherein the scaling means comprise a 
scaling divider to divide the watermark coefficients by the local average 
formed by the squarer. 

17. Apparatus as claimed in any one of claims 11 to 16, wherein the cross 
correlator comprises a multiplier to multiply the scaled watermark coefficients 
with the transformed input data. 

18. Apparatus as claimed in any one of claims 11 to 17, further comprising 
thresholding means to subject the output detection signal to a threshold. 

19. Apparatus as claimed in claim 18, further comprising an output divider to 
divide the output detection signal by a signal dependent on the global 
average of the power of the data. 

20. Apparatuses claimed in claim 19, further comprising an averager to 
average the output detection signal before it is divided by the output divider. 

21. A method of detecting the presence of a watermark in input digital data, 

f'rr mc^od boinn Er' ! bsf^ni'??!? v ?? hf? r ein^?fore described vim reference to 
Figure 3 or Figure 6 of the accompanying drawings. 
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22. Apparatus for detecting the presence of a watermark in input digital data, 
the apparatus being substantially as hereinbefore described with reference to 
Figure 3 or Figure 6 of the accompanying drawings. 
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